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Abstract 

Distributions with a heavy tail are difficult to estimate. If the design of a 
scheduling policy is sensitive to the details of heavy tail distributions of the 
service times, an approximately optimal solution is difficult to obtain. This 
paper shows that the optimal scheduling of an M/G/l queue with heavy tailed 
service times does not present this difficulty and that an approximately optimal 
strategy can be derived by truncating the distributions. 
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1. Introduction 

We consider the scheduling of jobs in an M/G/l queue when the service time 
distribution F of the jobs may have a heavy tail, but has a finite mean and variance. 
At any given time, the server remembers how long he has worked on each job in the 
queue and chooses which job to work on, possibly in a preemptive way. The objective 
of the server is to find a scheduling policy that minimizes the mean sojourn time of the 
jobs in the system. Can one derive a good scheduling policy by neglecting the details 
of the tail of Fl Let X be a service time of a typical job and let the rate of arrival be 
A. The result of the paper is that there exist constants K\ > and K 2 > dependent 
only on E{X), E{X 2 ) and A such that if s > is such that 

M[Jfl {x>s} ] + K 2 E[X 2 1 {X>S} ] < e 

* Postal address: Department of Electrical Engineering and Computer Sciences, University of 

California, Berkeley, CA, 94720, USA 

* Email address: {yjk, wfr}@eecs. berkeley.edu 



2 



Vijay Kamble, Jean Walrand 



for e > 0, then one can derive an e-optimal scheduling policy by truncating the 
distribution of X to s. Finding the value of s that corresponds to a given e > 
is simpler than estimating the details of the tail of the distribution of X, so this result 
has practical significance. Specifically, this e-optimal policy agrees with the optimal 
policy for the distribution F truncated at s, except that it switches to an arbitrarily 
chosen work-conserving policy when it discovers a job whose service time exceeds s. 
The same result holds when their are no arrivals, which we call the static case. 

2. The static case 

There are N jobs whose service times are independent and distributed according to 
distribution F. Fix a threshold s > 0. Let F s be the distribution F truncated at s, 
i.e. F s (a) = for oei The admissible scheduling policies are preemptive and 

such that the server bases his decision on which job to serve only on the amount of 
time he has spent on the different jobs so far and on which jobs are still in the system. 
That is, the server does not know the residual service times of the unfinished jobs. A 
policy is optimal if it minimizes the sum of the expected job completion times. Let V* 
be the expected sum of the completion times of the jobs under the optimal scheduling 
policy u. Let u s be the optimal scheduling policy for the system with the truncated 
service time distribution F s . Also, let u s be the policy that agrees with u s until it 
discovers a job with a service time larger than s, after which it switches to a given 
arbitrarily chosen work conserving strategy u. Finally, let V s be the expected sum of 
the completion times under policy u s . 

Theorem 2.1. (Static Case.) Assume that F has a finite mean. Then, 

limsup^^-y* =0. 

This result says that the scheduling policy for the truncated distribution is almost 
optimal for the original distribution. The policy for the truncated distribution switches 
to any arbitrary work-conserving policy if it discovers a job with a service time larger 
than the truncation threshold. The intuitive justfication for the result is that, on the 
event that no job has a service time larger than s, the policy u s makes the optimal 
decisions. In the rare event that a job has a service time larger than s, the policy 
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incurs an extra cost but its expected value goes to zero as s increases to infinity. 

Proof. Let the service times be the random variables X%,-- ■ Xm and let C(u) be 
the random variable denoting the sum of the completion times under a fixed policy u. 
Consider the event A = {Xi < s,i = 1, . . . , N}. We have 

V* = E[C(u*)} = E[C(u*) | A]P(A) + E[C{u*) \ A C ]P(A C ) 

> E[C(u s ) | A]P(A) + E[C(u*) | A C ]P(A C ) 

> E[C(u s )\A]P(A). (1) 

The first inequality holds since on the event that service times of all jobs are less than 
the threshold s, the optimal policy for the truncated service times achieves a lower cost 
than the optimal policy u* . Now, let us turn to the analysis of the cost under policy 
u s . We have 

V s = E[C{u s )] = E[C{u s ) | A]P(A) + E[C(u s ) \ A C ]P(A C ) 

= E[C(u s ) | A]P(A) + E[C(u s ) | A C ]P(A C ). (2) 

Thus, from ([T]) and ^ we have that 

V s -V* < E[C(u s ) | A C ]P(A C ). (3) 

Now suppose that, if at least one of the jobs has a service time which exceeds the 
threshold, we are told the exact realizations of Xi,-- - ,X^- With this additional 
information the worst sum of completion times is achieved by the policy where the 
server finishes serving all the jobs together. In that case, the completion time of each 
job is the sum of the file sizes. The expected cost under this policy is an upper bound 
for the cost achieved by any work-conserving policy which works without this additional 
information of the service times. Moreover, the upper bound for the cost under this 
policy is when the service times of all the files exceed the threshold s. Thus we have 

E[C(u s ) | A C ]P(A C ) < N 2 E[X t | X t > s]P(A c ) 

< JV 3 £[J*Q | X t > s]P{X l > s) (4) 

where the last inequality is a result of the union bound. Now, since E(Xi) < oo, it 
follows that 

lim E[X t l {Xi > s} ] = 0. 
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This completes the proof. I 

3. The dynamic case 

We now consider the optimal scheduling problem of an M/G/l queue. Since the 
process describing the number of jobs in the system is a renewal process that does not 
depend on the work-conserving policy, we consider a single busy period and our aim 
is to find a work conserving scheduling strategy u which minimizes the expected value 
of the sum of sojourn times of all jobs in the busy period. Formally, for a busy period 
labelled B, we want to minimize E{C(u)) where 

N B 

C{u) = Y. S * ( 5 ) 

i=l 

where N B is a random variable denoting the number of jobs that arrive in the busy 
period B, and S 1 , is a random variable denoting the sojourn time of job i when policy u 
is used to schedule the jobs. Let u* be the optimal policy with service times distributed 
according to F, and V* be the corresponding optimal expected cost. Fix a threshold 
s > and let u s be the optimal policy when all service times are distributed according 
to the truncated distribution F s . Also, let u s be the policy that uses the policy u s till it 
discovers a job whose service time exceeds s, after which it switches to an arbitrary but 
work conserving policy u. Let V s be the corresponding expected average of sojourn 
times of the jobs in a busy period under this policy. 

Theorem 3.1. (Dynamic Case.) Assume that distribution of the service time of a job 
F has a finite mean and variance. Let X be the service time of a typical job. Then, 
there exist constants K\ and K 2 dependent only on the mean and variance of F, such 
that 

V s -V* < MLYl {x>s} ] + K 2 E[X 2 1 {X>S} ]. 

Hence 

limsup^V'-V* =0. 

To prove the theorem, we will first need the following lemma: 

Lemma 1. Let X be the service time of a typical job. Consider a busy period B. Let 
W be the duration of the busy period and Nb be the number of jobs that arrive during 
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the busy period. For a threshold s, let A be the event that the service time of every job 
in the busy period is less than the threshold. Then 

1. E[W | A c ] < E[X]X 2 >s] . 

2. E[N B | A c ] <± + mX j\ x>s] . 
where D = 1- XE(X). 

Proof. We first compute an upper bound for P(A C ). This is the probability that at 
least one job in the busy period has a service time that exceeds the threshold. Suppose 
that the policy is first come, first served except that the lowest priority is given to the 
first job that arrives in the busy period. The number of jobs in the system as a function 
of time in a typical busy period under this scheduling policy is illustrated in fig. 1. Let 




Figure 1: The number of jobs in the system as a function of time in a busy period B under 
the policy which is first come first served except that lowest priority is given to the first job 
that arrives. "Sub-busy periods" interrupt the service of the first job until it finishes. 

X denote the service time of the first job. Then we have the following expression: 
P(A C ) = P(X > s) + P(X < s)E[l - cxp(-XP(A c )X) | X < s]. 
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This holds because while working on the first job with service time X, new busy periods 
with at least one job with service time that exceeds the threshold s and busy periods 
with no job with service time exceeding s arrive as independent Poisson processes with 
rate XP(A C ) and XP(A) respectively. These "sub-busy periods" interrupt the service 
of the first job until it finishes. But since 1 — exp(— x) < x, we have 

P(A C ) < P(X > s) + P(X < s)E[XP(A c )X | X < s}. 

Thus we have 

P(AC) < P{X > S) 

{ ' ~ 1- XP(X < s)E[X \X<s\ 

But since P(X < s)E[X \ X < s] < E(X), we have 

™ <- ^m-y M 

Now to prove part (1), we find an upper bound for E[W \ A c \. We again assume that 
the policy is first come, first served except that the lowest priority is given to the first 
job that arrives in the busy period. We use a first step argument that decomposes 
W into X plus the duration of the busy periods that arrive while the server processes 
the first job. Assume that K{X) busy periods arrive during the processing of the first 
job. Among these K(X) sub-busy periods, N(X) have at least one job with service 
time that exceeds s and M(X) = K(X) — N(X) have all jobs with service times 
less than s. Note that as mentioned before, conditional on X, the random variables 
N(X) and M(X) are Poisson with mean XXP(A C ) and XXP(A), respectively. Define 
a := E[W | A c ], S = E[W \ A] and 7 = P[X > s | A c ] = P ^ e f ■ Then > 

a = E[W I X > s,A c }j + E[W \ X < s,A c ](l- 7 ). 

Now, 

E[W I X > s, A c ] = E[W I X > s] = E[X \ X > s] + XE[X \ X > s]E(W). 
Also, 

E[W I X < s,A c ] 
= E[X + aE[N(X) I N(X) > 0, X] \ X < s, N(X) > 0] 
+ E[SE[M(X) I N(X) > 0,X] I X < s,N(X) > 0]. 
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E[N(X) | N(X) > 0, X] = APU ' lA 



1 - exp(~\P(A c )X) ' 



Since r~, — ~i — r < 1 + x, we have 

l+exp( — x) — 5 

E[N{X) | N(X) > 0,X] < l + XP{A c )X. (7) 

Also M(X) and N(X) are independent conditional on X. Hence, 

a < 7 {E[X | X > s] + XE[X \ X > s]E{W)) 

+ (1 - 7) (E [(1 + \P(A c )X)a + X + XP(A)XS \ X < s, N{X) > 0]) 
= 7 (1 + \E{W))E[X | X > s] 

+ (1 - 7) (a + (1 + \E{W))E[X \ X<s, N(X) > 0]) . 

Now denote E[X \ X < s,N(X) > 0] = c/>(s). Then we have, 

a < 7 _1 (1 + XE(W)) (jE[X \ X > s] + (l- ~f)(f)(s)) . (8) 
Now from the the definition of 7 we have 
E[W I A c ] 

P(A C ) , , ^/P(X>s) , , n , P(X>s), , A 

Now, (a) from the upper bound on P(A C ) in (6), (b) since E(W) = 1 J E \e(x) an< ^ ( c ) 
since c/>(s) = E[X \ X < s, N(X) > 0] < E[X \ X > s], we finally have 

E[W I A c ] < C (9) 

where 

C = ~E[X I X > s] and 
D = 1 - \E{X). 

We thus have the required result. 

Now to prove part (2), we find an upper bound for E[Nb | A c }. Again define 
13 := E[N B I A% p = E[N B \ A] and 7 = P[X > s \ A c ] = ^g^. Then, 

/3 = E[Nb I A > s, A c ]7 + E[N B \ X < s, A c ](l - 7). 
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Now, 

E[N B | X > s, A c ] = E[N B | X > s] = 1 + XE[X \ X > s]E(N B ). 

Also, 

E[N B \ X<s, A c ] 
= E[l + f3E[N(X) | N(X) >0,X]|X<s, N(X) > 0] 
+ E[pE[M(X) | N(X) > 0,X] | X < s,N(X) > 0]. 

Hence by same arguments as in the case before, 

P < 7 (1 + XE[X | X > s]E(N B )) 

+ (1 - 7) (E [(1 + \P(A c )X)f3 + 1 + XP{A)X P \X<s, N(X) > 0]) 
= 7 (1 + XE[X | X > s]E(N B )) + (1 - 7) (f3 + 1 + \E(N B )<P(s)) . 



Therefore, 

/3 < 7" 1 
Now from the the definition of 7 we have 
E[N B I A c ] 



1 + \E{N B )(jE[X \X>s] + (l- 7)<Ms)) 



(10) 



< 



P{A C ) 
P{X > s) 



1 + A ^^-) {^pwr E[x 1 x > s] + (1 - ^r )0(s; 



Now again (a) from the upper bound on P(A C ) in (j6J), (b) since E(N B ) = i^j^jq 
and (c) since (f>(s) = E[X \ X < s, N(X) > 0] < E[X \ X > s], we finally have 



E[N B \A C ] < P 



(11) 



where 



P 
D 



1 A 
1 - A-E(X) 



E[X I X > s] and 



which is the required result. 
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We now prove the main theorem. 

Proof. The system starts empty and we consider the first busy period. Let X be 
the service time of the first job that arrives. Let A be the event that every service time 
in the busy period is less than the threshold s. Then we have 

V* = E[C(u*)} = E[C(u*) | A]P(A) + E[C(u*) \ A C ]P(A C ) 
> E[C{u*) | A]P(A) > E[C(u s ) | A]P(A). 

The first inequality holds because we ignore the second term in the first expression 
while the second inequality holds because, on the event A, policy u s gives a lower cost 
than policy u* . By definition of u s and u s , one has 

V s = E[C(u s ) | A]P(A) + E[C{u s ) | A C }P(A C ). 

We thus have 

V s -V* <E[C{u s ) | A C ]P(A C ). 

Under any work conserving policy, the sum of sojourn times of the jobs in a busy 
period, is upper bounded by the total duration of the busy period times the number 
of files that arrived in the busy period, and this random variable is independent of the 
scheduling policy. Let W be the random variable denoting the total duration of the 
busy period and Ng is the number of files that arrived in tha busy period. Then we 
have 

V s — V* < E[WN B | A C ]P{A C ). (12) 

The rest of the proof is providing an upper bound on this quantity. We already have an 
upper bound for P(A C ) from We move on to find an upper bound for E[WNb \ A c ]. 
Again we use a technique similar to the one used in proving the lemma. Say that the 
policy is first come, first served except that the first job to arrive in the busy period is 
given the lowest priority. We use a first step argument that decomposes WNb into the 
contribution to this quantity by this first job in the busy period plus the contribution 
from all the sub-busy periods that arrive and interrupt while the server processes the 
first job. As in the proof of the lemma, assume that K(X) sub-busy periods arrive 
during the processing of the first job. Among these K(X) busy periods, N(X) have at 
least one job with service time that exceeds s and M(X) = K(X) — N(X) have all jobs 
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with service times less than s. Here as before, given X, the random variables N(X) 
and M(X) are independent poisson with mean \XP(A C ) and XXP(A) respectively. 
We define two sets of notation for the durations of these busy periods. The duration 
of all the busy periods are denoted by {Wk\ k — 1 • • • , K(X)} and the number of 
jobs in each of these busy periods is denoted by {N Bk ; k = 1 • • • , K(X)}. We will 
find it convenient to also denote the busy periods with at least one job with service 
time exceeding threshold s by {Wf, i = 1, • • • , N(X)} and the number of jobs in these 
busy periods by {N B , ; i = 1, • • • , N(X)}. Similarly, the busy periods with no job with 
service time exceeding threshold s are denoted by {Wj; j — 1, ■ ■ ■ , M(X)} and the 
number of jobs in these busy periods are denoted by {N-. ; j = 1, • • • , M(X)}. Also 
define 7 = P[X > s | A c ] = P( p ^ . Then, 

E[WN B I A c ] = E[WN B I X > s, A c ]j + E[WN B \ X < s, A C }(1 - 7). 

We now have the following decomposition: 

K{X) K{X) 

WN B = (X + W t )(l + N B t ) 

3=1 3=1 
K(X) K(X) K(X) K(X) 

= X+J2w i +J2w i N Bi +J2N Bk (X+ ]T Wj) 

i=l 3 = 1 fe=l j^k;j=l 

N(X) M(X) N(X) M(X) 

= X+^Wi+^Wj+Y^ W i N B t + E W i N B, 
i—1 j — 1 i—1 j—l 

N(X) N(X) M(X) 

+ E n bS x + E wi+ E wj) 

i=l l^i;l=l j = l 

M(X) N(X) M(X) 

+ E N §k {X+Y j W i + e - w m) (13) 

j — l i—1 m^j\m—l 

Now, 

E[WN B I X > s, A c ] = E[WN B \ X > s] 

K(X) K{X) 

= E[X+ J2\V t + J2 W i N Bi \ x >s] 

i=l 3=1 
K(X) K(X) 

+ E[J2 N Bk (X+ J2 Wj)\X>s}. 

fc=l j^k;j = l 
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Now for each sub-busy period i, is independent of X and J2f^k-j=i ^ e tnus 
have 

K(X) K(X) K(X) K(X) 

E\ N Bk (X + ]T Wj) | X] = E[J2 N Bk E[X + £ W 3 \ X] \ X] 

k=l ]¥=k;j = l k=l j^k; 3 = l 

= XXE(N B )(X + (XX - l)E(W)). 



Thus we have 

E[WN B | X > s,A c ] = E[X | X > s] [1 + XE{W) + XE(W N B )] 

+ E[XXE{N B ){X + (XX - l)E{W)) \ X > s] 
< E[X \X>s](l + XE{W) + XE{WN B )) 

+ E[X 2 | X > s]XE(N B )(l + XE{W)) (14) 

where the inequality arises since we ignore the negative term. Also, 

E[WN B | X < s,A c ] 

= E[WN B \ X<s, N{X) > 0] 

N{X) M(X) 

= E[X + ^2 Wi+ Wj \ X < s, N(X) > 0] (15) 

i=i j=i 

N{X) M{X) 

+ E[J2 WiN &i + WjN § . | X < s,N(X) > 0] 
i=i J= i 

N(X) N(X) M(X) 

+ E l E N bS X + E Wi+Y t W j )\X< s,N(X) > 0] 

i=l l=£i:l=\ j=l 

M(X) N(X) M(X) 

+ E[J2 N §h (X+J2Wi+ W m )\X < s ,N(X)>0}. (16) 

j — 1 i—l m^j;m=l 

Now from |7]) we know that 

E[N{X) | N{X) > 0,X] < 1 + APpl c )X 
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Hence, 

N(X) M(X) N{X) M(X) 

E[X + Y Wi + Y Wj + Y W z N 6i + WjN Sj | X < s,N(X) > 0] 

i — 1 j — 1 i — 1 J — l 

< E[X + (1 + XP{A C )X)E[W | A c ] + XP{A)XE[W \ A] \ X < a, N(X) > 0] 
+ E[(l + \P{A C )X)E[WN B | A c ] + XP(A)XE[WN B \ A] \ X < s,N(X) > 0] 
= 4>(s) (1 + XE[W] + XE{WN B )) + E[W \ A c ] + E[WN B \ A c ] (17) 
where (j){s) = E[X \ X < s, N(X) > 0]. Now 

N(X) N{X) M{X) 

E[ Y n bM + Y Wi+Y W i) I X > N ( X ) > 0] 

i=l l^i;l = l 3=1 

N(X) N(X) M(X) 

= E[YN Bi (E[X+ Y Wi+ Y W i \X,N(X)>0]) \X,N(X)>0}. 

i=l l=£i;l=\ j=l 

This holds because for each busy period i, N B is independent of X, N(X) and 
Ei™ i Wi + E*=i X) Wj. Furthermore 

N(X) M(X) 

e[x + y w i + J2 % i x > N ( x ) > °] 

ljii;l=l j=l 

N(X) M{X) 

< E[X + Y Wi + Y I X > N ( X ) > °] 

1=1 3 = 1 

= X + (1 + XP(A C )X)E[W | A c ] + XP{A)XE[W \ A] 
= X(l + XE(W)) + E[W | A c ] 

where the last part follows from |7]). We thus have 

N(X) N(X) M(X) 

E[ Y N Bt (X + Y W l+i2 W A I X > N ( X ) > °] 

1=1 l^i;l = l j=l 

N(X) 

< E[ Y N Bz (^(1 + AJ5(W)) + E[W \A C ])\ X, N(X) > 0] 

i=i 

= (1 + AP(A C )X)£;[^ B | A c ] + A£(W0) + E[W | ^ e 
= X 2 AP(A C )£[7V B | A C }(1 + XE{W)) + XXP{A C )E[N B \ A C ]E[W \ A c ] 
+ XE[N B | A C }(1 + XE{W)) + E[N B \ A C ]E[W | A c }. 
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And hence, 

N{X) N(X) M(X) 

E[ £ N §i (X+ £ m+J2 Wj) I X < s,N(X) > 0] 

< (j}'(s)XP{A c )E[N B | A C }(1 + XE(W)) + (j)(s)XP(A c )E[N B \ A C ]E[W \ A c ] 
+ <j)(s)E[N B | A C ]{1 + XE(W)) + E[N B \ A C ]E[W \ A c ] (18) 

where tf/(s) = E[X 2 \ X < s,N{X) > 0]. Similarly we have 

M(X) N(X) M{X) 

E iJ2 N Sk (X+J2w i + ]T W m )\X,N(X)>0] 

j — l i—l m^j;m— 1 

M(X) 

<E[J2 (X(l + XE(W)) + E[W | A c }) \ X, N(X) > 0] 

= XP(A)XE[N B | A](X(1 + \E{W)) + E[W \ A c }) 

= X 2 XP(A)E[N B | A](l + XE(W)) + XXP{A)E[N B \ A]E[W \ A c ]. 

And hence, 

M(X) N{X) M(X) 

E{ N Sk (X + Wi + W m ) I X < s,N(X) > 0] 

j—l i—l m^j;m=l 

< c/)'(s)XP(A)E[N B \A}(1 + XE(W)) 

+ 4>(s)XP(A)E[N B | A]E[W | A c ]. (19) 



Now combining equations (151, (17), (18) and (19), we have 



E[WN B | X < s,A c ] < cj){s){(E[N B \ A c ] + !){! + XE[W]) + XE{WN B ) 

+ XE[W | A C ]E{N B )) + cj>'(s)\E(N B )(l + XE{W)) 

+ E[WN B | A c ] + E[N B | A C ]E[W \ A c ] 

+ E[W\A C ]. (20) 



Finally, combining equations (14) and (20), we have, 
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E[WN B | A c ] < 7 \E[X | X > s] (1 + \E(W) + XE(WN B )) 
+ E[X 2 | X > s]A(l + XE(W))E(N B ) 



+ (1 - 7 ) \^E[W | A c ] + E[N B | A C ]E[W \ A c ] 
+ <P(s)((E[N B | A c ] + 1)(1 + A£[W]) + A£(W^V B ) 
+ A£[W | A C ]E(N B )) + <p'(s)\E(N B )(l + \E{W)) 
+ E[WN B | A c }) . 



And thus we get the upper bound: 



E[WN B | A c ] < 7" 1 



j[E[X | X > s] (1 + A£(VK) + A£(W^V B )) 



£[A: 2 I X > s]A(l + AS(T^))S(iV B ) 



+ (1 - 7) {E[W | A c ] + E[N B \ A C }E[W \ A c ] 
+ cj>{s)((E[N B | A c ] + 1)(1 + A£[W]) + A£(WAr B 
+ A£[W | A c ]£(Ar B )) + <f>'(s)\E(N B )(l + \E{W)) ) 



Now from the definition of 7, we have 

P{A C ) 



E[WN B I A C }P(A C ) < 



P(X > s)[E[X I X > s](l + XE(W) 



(21) 



P(X > s) 

+ XE(WN B )) + E[X 2 I X > s]A(l + XE(W))E(N B ) 



+ (P(A C ) - P(X > a)) \E[N B I A C ]E[W \ A c ] 
+ E[W I A c ] + <j>(s)({E[N B I A c ] + 1)(1 + \E[W\) 
+ XE(WN B ) + XE[W I A C ]E(N B )) 



+ 



'(s)XE(N B )(l + XE(W))] 



(22) 



Now since <f>'(s) < E[X \ X > s] and <f>'(s) < E[X 2 \ X > s], we have 
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P{A C ) 



P(A C ) \E[X I X > s] (1 + XE(W) 



P(X > s] 

+ \E{WN B )) + E[X 2 | X > s]A(l + A£(T40)£(^V 



^[VFiVs I A c ]P(yl c ) < 



+ (P(yl c ) - P(X > s)) [E[N B \ A C ]E[W \ A c ] 
+ E[W | A c ] + 4(s)(E[Nb I A C }(1 + XE[W]) 
+ XE[W | A c ]E(N B ))^j . (23) 
Finally, using the bound on P(A C ) in ([6]), and ignoring the negative term we have 

E[WN B | A C ]P(A C ) < M (24) 

where 
M = 



-jpPiX > s) ]E[X | X > s) ^(1 + £[jV B | A C }){1 + \E[W]) + XE{WN B ) 
+ XE[W | A c }E{N B )^j + E[X 2 | X > s]X(l + XE{W))E(N B ) 
+ E[W | A c ] + E[N B | A C ]E[W \ A c ] 



and 



D = 1 - A£(X). 

Now we have bounds for all the quantities in M . First, from the lemma, we have 

E[X | X > s] 



E[W | A c ] < 
E[N B | A c ] < 



D 2 

1 XE[X | X > s] 
D + D~ 2 ' 



Further, we can compute an upper bound on E(WN B ) using our decomposition : 



E{WN B ) 

K(X) K(X) K(X) K(X) 

= e[x+j2 w i + E w * N Bi + E Nb ^ x + E w i)\ 

i=l j = l k=l j^k-j = l 

K(X) K(X) 

= E(X)(1 + XE(W) + XE(WN B ))+E[E[J2 N B k ( x + E W o)\ X \\ 

fe=l j^k;j=l 

= E(X)(l + XE{W) + XE{WN B j) + E[XXE{N B ){X + (XX - 1)E(W))} 
< E(X)(l + XE(W) + XE(WN B )) + X(XE(W) + l)E{N B )E{X 2 ). 
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We thus have 



E{WN B ) < 



(E(X) + XE(N B )E(X 2 ))(XE(W) + 1) 
1 - XE(X) 



But again since E(W) = 1 E xe(x) an< ^ E(Nb) = i-\e(x) ' we nave 



E(WN B ) < 



E(X) + XE(X 2 ) - XE{Xf 



and thus ignoring the negative term, we have 



E{WN B ) < 



E(X) + XE{X 2 ) 
D3 ' 



(25) 



We thus finally have 



E[WN B | A C ]P{A C ) < M 

P{X > s) 



< 



D 2 



E[X \ X>s] 



D 2 + D + XE[X | X > s] 
~ IT 3 



XE(X) + X 2 E(X 2 ) XE[X \X>s] 



D 3 



D 3 



XE[X 2 | X > s] E[X | X > s] E[X \ X > s] 



D 2 

XE[X | X > s} 2 



D 2 



D 3 



(26) 



where we have substituted all of the computed upper bounds in ( 24 1 . Now by Jensen's 
inequality we have E[X | X > s} 2 < E[X 2 \ X > s). Thus we can further simplify the 
bound as follows: 



E[WN B | A C ]P(A C ) < 



P(X > s) 
D 4 



E[X | X > s] 2 + D 



1 + XE(X) + X 2 E{X 2 
D 



+ E\X' X s\[-+X+^ 



Thus we have 



V" - V* < E[WN B | A C ]P(A C ) < KtEiXlx^] + K 2 [X 2 1 X>S ] (27) 
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where 



K 2 



D 



1 

1 / 2A A 



1 + XE(X) + X 2 E(X 2 



D 



and 



(28) 
(29) 



Now lim^oo E[Xlx> s ] = lim^oo E[X 2 1 X > S ] = since E(X) < oo and E(X 2 ) < oo. 
Thus 

lim V s - V* = 

s— > oo 

hence proving the result. 



3.1. An example 

Consider A = 1 and assume that the service times of the jobs have the pareto 
distribution with the tail probability function 1 — F(x) = P(X > x) = ^^pjya l{a;>o} ■ 
The density function is fx(%) = fajrv 3 -*-{a:>o}- Then we have E{X) = | and i?[X 2 ] = 



1. Thus D = l-A-E'(X) = |. Then from equations (28) and (29) we find that K x = 120 
and Ki = 144. Further we can compute 



E[X1 {X>S} ] 
E[X 2 1 {X>S} ] 



3s + 1 



a and 



2(s + l) 3 
3s 2 + 3s + 1 

(S + l) 3 



Thus we have 



V s -V* < g(s) = 120 



3s + 1 
2(s + l) 3 



144 



3s 2 + 3s + 1 



(30) 



This function is plotted in fig. 2. 
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Figure 2: Upper bound g(s) as a function of truncation s 
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